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Method and device to identify a periodic light source 



This invention relates generally to devices for location positioning and more 
particularly relates to a method for identifying an environmental source emitting a base 
frequency and waveform signal. 

The present invention also relates to a system for performing the method and a 
5 computer program for performing the method. 



In various modem applications, it is essential for a device to know its location. 
Usually it suffices to know the room in which the device is located. This allows the 

1 0 application to be tailored to the location of a user of the device. This way, a so-called 
context-aware device is capable of adjusting its operations to fit the context in which the 
device is introduced. Context is any information that can be used to characterize the situation 
of an entity. An entity is a person, place, or object that is considered relevant to the 
interaction between a user and an application, including the user and application themselves. 

1 5 Almost any information available at the time of an interaction can be seen as context 
information. Some examples are: 

• spatial information - e.g. location, orientation, speed, and acceleration 

• environmental information - e.g. temperature, air pressure, light, and noise level 

• resources that are nearby - e.g. accessible devices, and hosts 

20 • availability of resources - e.g. battery, display, network, and bandwidth 

• physiological measurements - e.g. blood pressure, heart rate, respiration rate, and 
muscle activity. 

A system is context-aware if it can extract, interpret and use context 
information and adapt its functionality to the current context of use. The challenge for such 
25 systems lies in the complexity of capturing, representing and processing contextual data. 
To capture context information generally some additional sensors and/or programs are 
required. To transfer the context information to applications and for different applications to 
be able to use the same context information a common representation format for such 
information should exist. In addition to being able to obtain the context-information, 
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applications must include some "intelligence" to process the infomiation and to deduce the 
meaning. This is probably the most challenging issue, since context is often indirect or 
deducible by combining different pieces of context information. E.g. if three persons meet in 
a certain o£Bce room at a certain time, it can mean that it is the weekly strategy meeting. 
S Another situation would be when a context-aware application, such as a context-aware 
mobile phone, is placed in front of the user's personal computer at work, the application 
could then be given the information that the user do not wish to be disturbed with private 
phone calls. 

There are features that are characteristic for context-aware applications. 

10 Firstly, information and services can be presented to the user according to the current context. 
This includes the selection of proximate information and services, and contextual commands. 
Secondly, automatic execution of a service may be performed when being in a certain 
context. This includes context-triggered actions and contextual adaptation. An example of the 
previous would be that when a user enters a specific room her mails would be shown on a 

15 nearby terminal. An example of the latter would be the change on volume on a phone 
according to a current noise level. 

A very evident type of application is the ability to find nearby resources. This 
can include input and output devices: printers, displays, speakers, facsimiles, video cameras, 
thermostats, etc. In pure service lookup actually even no location information needs to be 

20 used. In situations where e.g. distance calculations have to be done location information of a 
device is required. 

The usage of context information is still quite limited since it is very 
challenging and complex to capture, represent, and process contextual data. The most used 
types of context information are location, identity and time information. The context-aware 

25 application development is mainly concentrated around user interfaces, virtual and 
augmented reality, mobile, handheld and wearable computing. There are very few 
commercial products using context information yet, because of the challenges in this field. 

There are several ways to obtain required location information. A variety of 
tracking systems exists, some of them based on the Global Positioning System (GPS) with 

30 which the location of a device can be determined. Systems for a positioning network such as 
the GPS is known for the purpose to locate virtually any place on the planet, however, such 
tracking systems are quite expensive which makes them unacceptable for low-cost consumer 
electronics. Other solutions involve the installation of positioning devices such as GSM, 
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DECT or Bluetooth beacons, etc. Furthermore it is known to adapt existing devices to act as 
sources of position information. 

A lighting soiurce can be modified to operate at a specific known frequency, 
which can be detected by a device and translated to a location. US 5,657,145 discloses a 
5 method of transmitting coded data signals by modulating the output fi-om light sources, e.g. 
electric lamps. The visible light wave is used as a carrier wave whereon the signals are 
transmitted. A wide range of digital information can be transmitted such as audio and video 
content, etc. Of course, this modulation can also be used to identify the light source. 

However, the light sources have to be modified to transmit the requested 
10 information and thereby be identified. It will though be advantageous not to modify ambient 
light sources for several reasons. 



It is an object of the invention to provide a method for location positioning of 

15 a device without the need for modifying environmental sources. 

It is further an object of the invention to provide a method for storing location 
parameters, which may be recovered for further processing. 

This is achieved by a method (and corresponding device) for identifying an 
environmental source emitting a base frequency and waveform signal, the method comprising 

20 the steps of measuring the waveform signal of the source in a predetermined time-interval; 
estimating a the emitted waveform characteristic of the measured waveform signal; and 
determining a number of actions based on the estimated characteristic. 

By omitting environmental source modifications, a positioning device 
according to the present invention may be more consumer-oriented, cause the lack of 

25 operational precautions. It may therefore be possible to quickly adapt a device according to 
the method of the present invention to a new environment without the need of installing 
sophisticated hardware. Therefore, the method of the present invention deals with 
recognizing environmental sources by their natural signal pattern without introducing a new 
pattern by artificial modulation. 

30 Further, the method according to the present invention proposes to identify a 

"fingerprint" of an environmental source, e.g. a light source, and to store this fingerprint, 
which in an embodiment of the invention is a waveform of a light intensity, in memory. The 
fingerprint can then be used to e.g. determine that the device has been in a given location 
before by use of information affiliated with data of the fingerprint. The affiliated information 



wo 03/090493 PCT/IB03/01279 

4 

may be instructions to execute a number of actions, e.g. user notification, external device 
controlling, data acquisition, etc. If light sources are operating periodically i.e. a source is fed 
by AC-voltage, not only the light intensity may be measured, but also a light waveform 
characteristic history can be derived by means of signal processing. Thereby, the method 

5 according to the present invention may be used to keep continuously track of a light source. 
Incandescent illuminations can be distinguished firom fluorescent and LED-based light etc. 
Moreover, the presence of a cathode ray tube can be detected and even distinguished by their 
characteristic refiresh rate and phosphorescence. That is, no alterations of the light sources 
have to be performed. Thereby the needs of a positioning device according to the present 

10 invention may be reduced to make use of natural properties of environmental sources only. 

Environmental sources may moreover count apparatus emitting sonic signals, 
e.g. a fan emitting a characteristic humming sound or electromagnetic radiation descended 
from an electric motor or an alternator etc. 

Information is stored in the device according to the present invention where 

15 the information may be associated to a number of waveform characteristics. The information 
may be any kind of data such as instructions, user input, data pointers, etc. A waveform 
characteristic may be defined to be a calculation based upon a firequency and a waveform of 
e.g. a sampled light source. The light characteristic may for example be a spectrum analyse 
representative of the sampled signal. If a processed signal is periodic, a base frequency may 

20 typically be found. The found base firequency (the lowest valid signal firequency which 
represents the interval between the spectral bands which can be computed from the 
waveforms) may have relevance by comparing a set of signals. By knowing the base 
frequency, more efficient signal detection algorithms may be adapted to perform a signal 
comparison. 

25 By performing autocorrelation on a periodic signal, any undesirable signals 

within may be suppressed. This is a well-known technique to suppress and sometime even 
eliminate undesirable noise to get a clean measurement signal. A further technique for 
cleaning a signal, i.e. noise cancellation, is by averaging a signal over a number of periods. 
Thereby, not only noise will be reduced, but also any potential sample errors during signal 

30 capturing such as jitter, timing errors, etc. may be reduced significantly or eliminated. When 
a light intensity characteristic is calculated, it may be altered in amplitude, e.g. normalized, 
re-sampled, stretched in time, etc. to achieve a uniform, storable and comparable 
characteristic stature. 



wo 03/090493 PCT/IB03/01279 

5 

A base frequency of a digital sampled signal may be derived by use of Feist 
Fourier Transform (FFT), which is generally known to be a stable and eflRcient method, but 
other methods may alternatively be applied according to the type of sampled data. Since a 
FFT calculation sometimes do not output an accurately and acceptable result, in this case the 
S base frequency, the FFT output may be refined by using a method comprising interpolation. 
This refinement typically increases reliability to an acceptable level of confidence. 

After deriving a valid light intensity characteristic, a sample-by-sample 
comparison of this and a unique characteristic may be performed. The estimated 
characteristic typically consists of an averaged period of a discrete waveform. For 

10 comparison of two signals, it is often useful that the signals are phase aligned. Therefore it 
may be advantageous to phase shift one of the signals to obtain phase synchronization. For 
this purpose a ring buffer may be used. By rotating the buffer a requested number of samples 
the two samples may be phase aligned. Thereby a direct and simple sample-by-sample 
comparison may be applied. The two waveforms may be compared with respect to an offset 

1 5 value and/or deviation magnitudes to accept a wider range of near identically waveforms. 

If an estimated waveform cannot be found acceptable identically for any 
already known stored waveform, it may be decided to accept greater deviations or, if 
necessary, to store the new and incomparable waveform as a new unique light intensity 
characteristic. Thereby the nvmnber of recognizable and separate light intensity characteristics 

20 may be increased for fiiture processing tasks. 



These and other aspects of the invention will be apparent firom and elucidated 
with reference to the embodiments described hereinafter in conjunction with the drawings, in 
25 which: 



Fig. 1 illustrates an embodiment of the current invention for waveform 
detection, signal conversion and signal processing. 
30 Fig. 2 shows a waveform of light emitted by an incandescent lamp provided 

with 50 Hz AC. 

Fig. 3 shows a waveform of light emitted by a fluorescent lamp provided with 

50 Hz AC. 
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Fig. 4 shows a waveform of light emitted by a computer monitor with 76 Hz 

refresh rate. 

Fig. 5 shows a waveform of light emitted by a computer monitor with 100 Hz 

refresh rate. 

5 Fig. 6 illustrates an embodiment of the current invention for light detection, 

signal conversion and signal processing with two independent light detection circuits. 



Fig. 1 illustrates an embodiment of the invention to identify an environmental 
10 source, in the following a light source. The phototransistor (101) is operated with a bias 

voltage by the pull-up resistor (106) in the linear region to pick up light emitted from ambient 
light sources. The phototransistor (101) output may be amplified (102) to feed the A/D- 
converter (103). The current measured by the ADC (103) may be proportional to the light 
intensity as long as the light is not too bright. The processing device (104) may carry out 
1 5 computations for a signal-processing algorithm described in the following. Since most 
artificial light sources typically have operating frequencies of a few hundred Hertz, it is 
typically sufficient to sample the signal in the ADC (103) at a few thousand Hz. The 
workload for the algorithm in the processing device (104) is therefore moderate since signals 
of interest have a relative low frequency. Thereby it is possible to make use of inexpensive 
20 components which further is preferred for consumer-oriented products. To obtain a 

characteristic for a signal, it may be usefiil to identify a base frequency of the signal and 
additionally a waveform thereof. The signal processing method in the DSP (104) used to 
derive a light intensity characteristic may therefore comprise the steps explained in the 
following. It is to be understood, that values in the following, such as the sample rate and 
25 sample length, etc. easily may be changed to fit a given embodiment. 

1) The input signal from the ADC may be a Pulse Code Modulated (PCM) signal sampled at 
g kHz. The signal is partitioned into non-overlapping frames of N = 2048 samples. Each 
sample is multiplied with a Gaussian window function to minimize spectral leakage. A 
Fast Fourier Transformation (FFT) is computed on the frame resulting in N spectral 
30 coefficients. Low and high frequency components (<10 Hz, >7 kHz) are removed by e.g. 

a band pass filter since these parts of the signal do not contribute to the signal being 
recognized. The spectral coefficient of maximal power is located, which provides a 
coarse estimate of the base frequency. Thereby an indication of the expected frequency 
found in step 2 is to be found. 
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2) The same input signal as used in step 1 is used to improve the base frequency estimation. 
An estimation of the ftequency corresponds to an estimation of the period, here in 
number of samples. For each potential period T in the confidence interval estimated in 
step 1, the average power of x[k] - x[k-T] is computed, where x[0], . . x[N-l ] are the 

5 samples of the frame. The location T of the minimal power is located by e.g. second order 

interpolation. A frequency estimation like this is usually more accurate than a single 
sample interval by depending on choosing an appropriate size of the autocorrelation 
window. 

3) The accurate estimation of the signal period T is used to extract the waveform of the 

10 periodic signal. This is done by splitting the input signal into non-overlapping frames, the 

k-th frame starting at round (k*T). The frames are averaged with a first-order low-pass 
filter resulting in an estimated waveform and a confidence interval for each position of 
the waveform. The low-pass filter used in this example is defined as y[n] = (1-a) y[n-l] + 
a x[n], a = 0. 1 . It is important that step 2 returns a sub-sample accurate estimation of T, 

1 5 because otherwise the period would drift away and the averaging process would remove 

details of the waveform. By this avjsraging process unwanted noise e.g. flicker noise, 
thermal noise, etc. may be minimized to approach a cleaner signal. 

4) The final processing step is to rotate the waveform within the frame such that it is 
positioned in a fixed relation to the period. For example, if the waveform is just only one 

20 peak it should always appear at the same position. To find a fixed reference position 

within the waveform, the first non-DC coefficient of the FFT of the signal is calculated. 
The phase of this complex number indicates the phase-shift by which the waveform 
should be rotated back. The result of this method is a very stable waveform within the 
frame since is uses a global property of the waveform and not just a local featiure such as 
25 the maximum. 

In a preferred embodiment of the present invention the algorithm reads a 8 
kHz linear PCM sampled signal as input and outputs an estimation of the dominant frequency 
and waveform of the most powerful periodic signal rate at about 4 Hz as the sampled signal 
is partitioned into non-overlapping frames of 2048 samples. 
30 The amplifier (1 02) may comprise means to avoid overloading of the ADC 

(103) by the input signal. If the received light is too intense the amplifier gain or e.g. a signal 
compressor may be adjusted to overcome this. Likewise, the sampled signal may be 
normalized in the DSP (104) upon signal comparison to preserve comparable amplitude 
levels. 
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The DSP (104) preferably comprises a memory (107) for storing a number of 
calculated light intensity characteristics. It may be possible for the DSP (104) to compare two 
signal characteristics with a range of allowed deviation among. In a preferred embodiment, 
the device further comprise means for recording, i.e. storing, a new calculated light 
5 characteristic, i.e. waveform. 

Fig. 2 shows a waveform of light emitted by an incandescent lamp provided 
with 50 Hz AC. Since the current provided oscillates with 50 Hz, the light modulation will be 
100 Hz with a near sinus-shaped waveform. If the sampling frequency is 8 kHz like the 
above-mentioned embodiment and the window sampling window is of a size of 2048 

10 samples, an averaging of the sampled signals may be applied by for example 10 periods, 
M^ch is often plentiful for a valid signal approximation even in a heavily noised 
environment. Non-periodic signals such as random noise may thereby be virtually eliminated. 

Fig. 3 shows a waveform of light emitted by a fluorescent lamp provided with 
50 Hz AC. Likewise the incandescent lamp, the modulated light frequency will be around 

15 100 Hz but not smooth-curved in the same way as in figure 2, though. By sample-by-sample 
comparison of the sample waveforms for fig. 2 and fig. 3 respectively, a relative difference in 
the waveform shapes may be foimd. Thereby the DSP may conclude that the two light 
characteristics hardly origin from the same source of light. It may, however, be concluded 
that the two waveforms are acceptable identical if for example no shape of more identical 

20 waveforms are stored. It is to be imderstood that the selection threshold may vary according 
to stored information. 

Fig. 4 shows a waveform of light emitted by a computer monitor with 76 Hz 
refresh rate. The refresh frequency can be easily detected as a pulse which shape depends on 
the content of the display. Since the waveform length will be different from the 50 Hz 

25 supplied signals, a sample-by-sample comparison with the 76 Hz will not be necessary. By 
comparing the waveform lengths it will show that the signals belong to different categories 
(100 Hz and 76 Hz respectively). 

Fig. 5 shows a waveform of light emitted by a computer monitor with 100 Hz 
refresh rate. Again, first the sample length has to be compared with waveform lengths stored 

30 in memory. The monitor operating by 76 Hz may therefore not be categorized with the new 
100 Hz monitor signal, as the 76 Hz signal may be longer in number of samples. However, 
the wavefomis in fig. 2 and fig. 3 may be categorized as possible identical waveforms in 
conjunction with the 100 Hz monitor signal. 
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Next step may be above-mentioned sample-by-sample comparison to unveil how closely the 
signals resemble. The comparing DSP algorithm may e.g. tolerate deviations of frequency, 
wavefomi data, etc. to compensate for measuring and/or calciiiation inaccuracies. 

Fig. 6 shows another embodiment of the present invention, wherein the DSP 

5 (104) processes inputs from the two light detecting circuits (108a, 108b) comprising pull-up 
resistor (106a, 106b), phototransistor (101a, 101b), amplifier (102a, 102b), and ADC (103a, 
103b). By using two or more inputs, the relative orientation of a device may be determined in 
contrast to the use of only one light sensor. For this it may be necessary to use detectors with 
different sensitivity characteristics. In contrast to a standard digital camera, this camera with 

10 just a few pixels is very fast in computing the direction and further, only sensitive to periodic 
light sources. A possible application for this is a pointing device that does not need a fixed 
reference as long as there are periodic light sources aroimd. 

There are several applications for the method according to the present 
invention to identify a "fingerprint" of a periodic light source, some of them described in the 

IS following: 

• "Been here before": The identity of a light source provides information about the location 
of the light detector. In particular, mobile devices equipped with a detector can recognize 
that the user is now in a room where he or she has been before by inspecting the room 
lighting or CRT screen available. 

20 • "Remember this": As before, but the detector is explicitly trained to remember a certain 
light source by pressing a *record'-button. Then this source is uniquely identified among 
others. For example, a certain CRT can be found back again. Or the light source has been 
specifically designed as a *beacon\ e.g. an infrared LED sending out a fixed bitsequence 
repeated periodically. The mobile device remembers this particular signature as a 

25 reference point, 

• "Orientation Sensor with arbitrary Reference Point": Since the method of this invention 
allows to identify an arbitrary periodic light source, it can be extended easily to locate the 
relative orientation of detector and light source. For this it may be necessary to have 
several detectors with different sensitivity characteristics. After the joint signal of the 

30 detectors is locked to a periodic light source, its direction-of-arrival can be computed 

from a comparison of the relative intensity for the detectors. In contrast to a standard 
digital camera, this *camera with just a few pixels' is very fast in computing the direction 
and only sensitive to periodic light sources (natural or planted on purpose). A possible 
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application for this is a pointing device that does not need a fixed reference, as long as 
there are periodic light sources around. 

• "Suppress Periodic Interference": As a completely different application, the method of 
this invention can be used to suppress the main periodic signal from the signal coming 
from a light detector. For example, it is known that TL-lamps interfere with remote 
controls for consumer applications. 

This is usually solved by modulating the remote control at about 30 kHz and 
applying a band pass filter to the intensity signal. However, the power of the interference can 
be much larger than the communication signal. The method of this invention allows to 
predict the periodic interference and subtract it from the light signal to obtain a cleaner 
communication signal. It is even possible to use the predicted signal to adjust the 
preamplifier of the light detector to avoid overloading the detector. 

• "Quality Control for Lamps": Another different application is the quality control of 
lamps, either during fabrication or during use. Most common types of lamps produce 
periodic light v*ere the details of the waveform are characteristic for properties of the 
actual source. 

For example, TL-lamps close to their end of life show a significantly higher 
amount of flicker and noise. In the development of this invention this deviation from nominal 
performance has shown clearly. Therefore it should be possible to use it for service and 
maintenance by detecting lamps that are likely to fail in the near ftiture. Currently, we do not 
know die actual dependency of residual lifetime and light pattern. This is subject to fiirther 
investigation if seen as promising. 

• "Triggering Digital Scopes": Yet another application involves the signal processing 
method of this invention, without the light sensor part. An important and difficult part of 
digital scopes (to show electric signals) is the generation of trigger impulses. The method 
of this invention allows producing stabile triggering for periodic signals. This is an 
extension to existing trigger methods based on local features of the signal like 'peak- 
trigger' etc. 

The uses of general-purpose microprocessors, instead of DSPs, are a viable 
option in some systems design. Although dedicated DSPs are well suited to handle signal- 
processing tasks in a system, most designs also require a microprocessor for other processing 
tasks such as route managing, etc. Integrating system functionality into one processor may be 
the best way to realize several common design objectives such as lowering the system part 
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count, reducing power consumption, minimizing size, and lowering cost, etc. Reducing the 
processor count to one also means fewer instruction sets and tool suites to be mastered. 

While the description above refers to particular embodiments of the present 
invention, it will be understood by someone skilled in the art that many of the details 
5 provided above are by way of example only, and modifications may be made without 
departing from the scope thereof. 

The accompanying claims are intended to cover such modifications as would 
fall within the true scope and spirit of tiie present invention. The disclosed embodiments are 
therefore to be considered in all respect as illustrative and not restrictive, the scope of the 
1 0 invention being indicated by the appended claims, rather than the foregoing description, and 
all changes come within the meaning and range of equivalency of the following claims are 
therefore intended to be embraced therein. 



